|
|
Proposal and application of model for testing DWH implementation on Teradata platform
Lysáček, Jakub ; Matuštík, Ondřej (advisor) ; Meixner, Jiří (referee)
The thesis focuses on application of theory of software testing in data warehousing area. The main goal of the thesis is an introduction of selected theory of software testing and analogical use of the theory in data warehousing environment. Part of the main goal is an introduction of architectonic model of testing process and later on focusing on part of testing which is problematic in data warehousing area. Partial goal of the thesis is validation of problematic part of the model using practical scenario. This partial goal is divided into two parts. First part focuses on requirements gathering and categorizing their priority. Second part focuses on demonstrating how project requirements, available resources and Teradata specific environment manipulate with the testing process. Theoretical part summarizes selected theory of software testing which is later applied in the area of data warehouse testing. The chapter introduces phases of data warehouse testing and specific goals of each testing phase. Chapter also describes model FURPS which is used to classify software quality dimensions a selected methods of requirements priority classification. An architectural model of testing process and its entities are described in the second part of theory. The theory then focuses on problematic part of the model which is requirements gathering and classification of their priority and demonstrates the influence of time, quality requirements and available resources on the overall process of testing. Practical part introduces a real-life scenario which demonstrates an application of described theory, namely requirements gathering, classification of requirements priorities and assigning dimensions of quality. The next part demonstrates the influence of available resources and requirements on the scope of testing. The outcome of the practical part of the thesis is that requirements gathering and classification of their priorities allows us to classify and sort scope of testing into logical and clear units, assign roles and their responsibilities and flexibly react on changes of project requirements. The thesis also points out that there are risks associated with changes of scope and emphasizes on the need of their evaluation.
|
|
|
Teradata: Application of MVC and BLC on data warehouse.
Bednář, Josef ; Pour, Jan (advisor) ; Gála, Libor (referee)
The topic of the thesis has been chosen based on efforts of an unnamed company for better data warehouse optimisation. Since the ETL process at the company has been changed, which led to the migration to Teradata database system, it would be appropriate to perform both the operation optimisation, as well as capacity optimisation. The first part of the thesis describes the Teradata concept and its architecture. This part particularly focuses on the Statistics which belong to the system operation optimisation. The main part of the thesis subsequently deals with Compression. Teradata uses several types of compression. The practical part brings the application of Multi Value Compression which has been performed via an appropriate tool. In order for the generated scripts to work correctly, they had to be adjusted. Additionally, defect reporting was performed and the communication with the development team also took place. The results of the table compression is compared with the estimations. The compression was applied on the production environment. The BLC process consisted of appropriate tables identification and compression testing. Based on the results of the testing, recommendations have been established.
|
|
|
Client workers‘ performance reporting
Klepetko, Vítězslav ; Novotný, Ota (advisor) ; Pour, Jan (referee)
The thesis aims at design and implementation of a corporate performance management system in retail banking. It proposes a tree of performance metrics based on Dupont pyra-mid model. Using financial as well as non-financial measures, the proposed model manages to link all levels of management together into one shared hierarchy. As a result, the model shows how performance of a single worker adds up to the performance of the company as a whole. The model uses financial metrics such as interest margin, account balance, fees and remuneration cost and links them with non-financial measures such as client worker activities with clients, success rate of marketing campaigns, or client complaints. Implementation of the corporate performance management system is done using regular business intelligence tools. Third normal form data warehouse is the source for all data needed. A datamart on Teradata platform is proposed to hold the SQL transformed data from the data warehouse. Using the datamart a metadata layer in Microstrategy is created to distribute data among users.
|
|
|
Data warehousing on technological platform TERADATA and Informatica in the insurance industry
Šiler, Zdeněk ; Maryška, Miloš (advisor) ; Hanušová, Jana (referee)
This thesis focuses on data warehousing on technological platform TERADATA and Informatica Power Center (further only IFPC). TERADATA provides a robust database system for storage of big volume data and query processing over such data. Product Informatica Powercenter is a tool for developing of ETL processes. Both of tools belong to mature technology for large data warehouse development which stores large volumes of data over the enterprise. The thesis analyses both tools to build data warehouse and the specifics of their use in the insurance sector. The thesis is divided into two main thematic sections - theoretical and practical part. The theoretical part describes database system TERADATA and ETL tool IFPC in details, including analysis of business intelligence architecture in the insurance segment, which often uses this platform for data warehouse development. The thesis describes the architecture of database system TERADATA and the way to data storage and query processing. Then specific features, on which is necessary to focus by TERADATA data warehouse development, are characterized. Also its advantages and disadvantages are analyzed. Database system TERADATA is faced with other competing database systems. The thesis deals with general characteristics of ETL tool IFPC -- software architecture a its components. It examines the advantages and disadvantages of IFPC compared to competitors on the market. Conclusion of the theoretical part analyzes the synergies between Teradata and IFPC. The thesis explains the real benefits of combination TERADATA and IFPC. The practical part of thesis demostrates the use of tools for data warehousing development on real project Unification of client data. This project describes the entire development process in a data warehouse from business requirements through functional and technical design to implementation of ETL mapping in Informatica Power Center. It deals with bug fixing during ETL development and testing methods. The pratical part focuses on implementation of chosen mapping in IFPC which is deployed in the insurance sector. Part of this thesis is a comparison of ETL tools IFPC with SSIS ETL tool integrated in MS SQL Server 2008 R2.
|
|
|
Comparison of system capabilities of Teradata and Oracle
Mimra, Jonáš ; Palovská, Helena (advisor) ; Vedral, Jakub (referee)
In my work, I deal with two database systems, Oracle and Teradata. I compare differences in data storage and database architecture. My work examines the performance of both systems installed on one operating system. The analysis was based on the speed of data import and response on SQL queries such as SELECT, SELECT with JOIN and UPDATE. Based on the results of my measurements recommend which of these two systems suits best OLAP and which OLTP database data storage technology.
|
|
|
Data Warehouse Management and MWF Optimization
Matoušková, Barbora ; Maryška, Miloš (advisor) ; Faina, Michal (referee)
This thesis focuses on the data warehouse of an extensive bank intitution from its operational management point of view (for the main part). To grasp the fast overview of the data warehouse the thesis includes the description of its data architecture, transformation processes and the way of presenting data to its users. Besides that the description of systems used for both the business data and for the metadata purposses is also included in this thesis. The thesis also covers operational activities including the identification of weak areas and their improvements. Another part of the thesis is represented by the project of optimization of a scheduling mechanism (Master Workflow) for running transformation processes, that helps to minimalize the metadata load of the Teradata database system. The main goal of this thesis is to describe the environment of the data warehouse in an understandable way. It's critical to understand the environment for both, the operational management personnel and for developers, that can supply the warehouse with higher quality solutions and ease the deployment of new deliveries into the production environment. This goal is achieved by the description of the data warehouse (mainly the description of its data architecture, transformation processes, operational activities and tools used to deploy changes into the production environment). Another goal is to give a feedback on the operational activities from the operational personnel point of view. This helps identify weak spots and can lead to its elimination. The last goal is to improve the scheduling mechanism that controls and runs all transformation processes. This goal is achieved by a project. The thesis describes the starting state, implemented changes, final state and the consideration whether the project was successful or not. The thesis brings several contributions: easier understanding of the data warehouse and the way of managing ETL processes -- for the operational management personnel and developers, which can bring the improvement of new solutions. The possibility of elimination of weak areas in the operational activities. And thanks to the project described there are two changes -- standardization and the metadata load of Teradata decreased. My own contribution to this issue is, besides the useful introduction to the data warehouse, the identification of the weak areas, suggested improvements and also the project of optimization Master Workflow which took about 17 MD. The thesis is devided into chapters based on the topics described: introductory information, theoretical base, characteristics of the main systems, the description of the data warehouse, the description of operational activities including the identification of weak areas, and at the end there is the project of optimization of Master Workflow. In the last chapter there is the final conclusion of the entire thesis.
|
|
|
Workload management in data warehouses using Teradata Active System Management architecture
Taimr, Jan ; Pour, Jan (advisor) ; Omacht, Jiří (referee)
This work is focused on the workload management of data warehouses based on Teradata technologies using Active System Management architecture. Objectives of this work are to characterize and analyze Active System Management architecture and types of rules, used in the workload management of Teradata data warehouses. These objectives have been achieved by a search of available resources and their subsequent analysis. Informations obtained from the analysis were empirically verified on a particular instance of a data warehouse and their synthesis is presented in this work The contributions of this work are in the documentation of technology that is currently not well known and widespread in the Czech Republic. Another contribution is identification of risks, drawbacks and presentation of recommendations in the workload management using Active System Management based on empirical tests. The repeatable implementation procedure based on induction has been proposed in the work. Maturity of the architecture for a production environment is evaluated. The work is hierarchically divided into several chapters that are dedicated to Teradata database technologies, workload management, Active System Management and implementation procedure. The first three chapters are focused on theory, however, they also contain practical informations related to the processed theory. The latter chapter is focused practically, therein is designed a repeatable Active System Management architecture implementation procedure.
|
|
|
Roles in Data Governance
Reken, Jaroslav ; Slánský, David (advisor) ; Pour, Jan (referee)
This work is covering the area of Data Governance (DG) with the main focus on roles in DG. First part is capturing the DG field from a basic perspective. This chapter introduces main principles of DG and is considered as a guideline for better understanding of the second chapter. The second chapter contains different approaches on DG and on roles in DG. The approaches are from world leaders in the field of DG like IBM, Teradata, KIK Consulting and The Data Governance Institute. In the summary of second chapter you can find a comparison of these different approaches to organization structure and roles in DG. The third and final chapter contains my own approach to organization structures and roles in DG. You can find there a wide variety of roles divided by different factors. This will give you a very good and unique perspective on roles and it might be also helpful as a guideline for necessary roles in the implementation process of DG program.
|
|
|
Teradata Database System Optimization
Krejčík, Jan ; Chlapek, Dušan (advisor) ; Štaud, Karel (referee)
The Teradata database system is specially designed for data warehousing environment. This thesis explores the use of Teradata in this environment and describes its characteristics and potential areas for optimization. The theoretical part is tended to be a user study material and it shows the main principles Teradata system operation and describes factors significantly affecting system performance. Following sections are based on previously acquired information which is used for analysis and optimization in several areas of described environment.
|
|
|
Comparison of robust and open source database management systems
Vích, Marek ; Chlapek, Dušan (advisor) ; Krch, David (referee)
Práce se zabývá problematikou objektově-relačních databázových systémů. Cílem je analýza současné situace na poli databázových platforem ze sféry tradičních robustních i open source produktů, která by vedla k posouzení předpokladů uplatnění otevřených databázových platforem v oblastech dosud charakteristických především pro tradiční distributory. Na počátku práce nejprve přibližuji čtenáři otázky související s distribucí softwaru (proprietární vs. open source) a základní pojmy v oboru databázových systémů. Po tomto výchozím uvedení stanovuji kriteria pro následnou komparaci vybraných databázových platforem, která předurčují další postup v rozhodující části věnované komparační analýze. K dovršení celého rozboru práci uzavírám nastíněním přítomných možností využití tradičních robustních a především pak open source databázových systémů. Komparační analýza je vystavena na základě předem definovaných kritérií do pěti oddílů zohledňujících základní charakteristiky, technologické a funkční vlastnosti, bezpečnost, dostupnost i podporu produktů a nevěnuje se rozboru z hlediska výkonu a optimalizace. Za účelem srovnání byly vybrány čtyři přední databázové systémy ? Oracle, DB2, Teradata a PostgreSQL. V návaznosti na důkladnou analýzu, která vedla ke zmapování aktuální situace na databázovém trhu, jsou v závěru práce vytknuty hlavní faktory kolidující širšímu uplatnění open source platforem.
|
guest ::
